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Abstract 

We give a uniform algebraic framework for computing hybrid spectral transforms in an efficient 
manner. Based on properties of the Kronecker product, we derive a set of recursive equations, 
which leads naturally to an algorithm for computing such transforms efficiently. As a result, many 
applications of transforms like the Walsh transform and the Reed-Muller transform, which were 
previously impossible because of memory constraints, have now become feasible. The same set 
of recursive equations also gives a new way of explaining hybrid transform diagrams, an efficient 
data-structure for integer valued boolean functions. 
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1 Introduction 

Spectral transformations of boolean functions [14, 17], like the Walsh or Reed-Muller trans¬ 
formations, have numerous applications in computer aided design, especially in the synthesis 
and testing of combinational circuits. Using a straightforward implementation, the complex¬ 
ity of computing these transformations grows rapidly in the number of variables of the 
boolean function. In the past, this has scverly limited the usefulness of spectral techniques 
for industrial applications. New techniques for computing the spectrum of a boolean function 
using binary decision diagrams, have made it possible to compute concise representations 
for the transforms of functions with several hundred variables [ 10 ]. 

This has led to a proliferation of similar transforms including MTBDD [ 6 ], FDD [5], 
BMD [5], OKFDD [ 11 , 12, 18], and others [17]. It is often difficult to understand, how 
those transforms are related. In this paper we consider a class of transforms, called hybrid 
spectral transforms [7, 8], which encompasses all of these transforms. Let F he <i function, 
which maps boolean vectors of length n into some set D, The Q spectrum of F is a linear 
transformation Qf of the vector representation / = ( F(0,..., • • • ? 1)) oi F. 

We consider only spectral transformations Q, which are constructed as Kronccker products 
of certain elementary matrices. When we want to emphasize a particular hybrid spectral 
transformation Q, we call it a (hybrid) Q transformation. We provide a uniform algebraic 
framework for reasoning about such transformations. This framework is based entirely on 
properties of the Kronecker product. We derive a set of recursive equations, wffiich lead natu¬ 
rally to an algorithm for evaluating products of the form Qv where Q is given as a Kronecker 
product, and v is a vector. Typically the hybrid spectral transformation is given by a matrix 
Q. This matrix maps a vector representation of the original function to the Q spectrum 
of F, the vector representation for the Q transform. We show' how' various spectral trans¬ 
forms like the Walsh transform and the Reed-Muller transform can be computed efficiently 
using this algorithm. The same set of recursive equations gives a new' way of explaining 
hybrid transform diagrams, an efficient data-structure for representing the Q transform for 
D valued boolean functions. The methodology developed in this paper also yields a concise 
classification of all known applicable spectral transformation diagrams. 

This paper is organized as follow's: Section 2 describes the notation W'e use for boolean 
functions. Section 3 introduces the Kronecker product, and gives an efficient algoritm for 
computing the product Qu of a matrix Q given as a Kronecker product and the vector v. 
Section 4 gives a uniform treatment of hybrid spectral transforms in terms of Kronecker 
products. We show in section 5, how such transformations can be represented concisely by 
using a generalization of the MTBDD. The paper concludes in section 6 w'ith a summary 
and some directions for further research. 

2 Binary tree indexing of boolean functions 

Let F : D he Zi D valued boolean function; assume that F is given in tabular form 

{(6, F{b)) I h € Since the vector b — ( 60 , • • •, K-i) is encoded by an integer c{x) where 
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Figure 1: Decomposition of a vector using binary tree indexing 


X ^ (0,..., 2^^ “ 1}, the list of values of F can be represented conveniently as the vector 

/=(F(c(0)) ... F(c(2«-l))f . 

Alternatively, / may be interpreted as a vector indexed by boolean sequences of length n. A 
boolean sequence is either empty (denoted e), or of the form cO or cl, whore c is a boolean 
sequence. Let v be a vector of dimension 2^\ and c a boolean sequence of length \c\ < n — l. 
Then, we use the following indexing scheme: i?|c is defined such that 

vl = v, and , 

where u|co and u|ci have the same length. This scheme is called binary tree indexing. 

When this scheme is expressed in terms of indices, we obtain: 

v\, = v , 

Let v\c = (t>o • • • V 2 ’--i Y whore r = n — |c|, then 

l'li:0=(5o ... iV-'-l )'^ > 

u|=l = (fv-l ••• hr-lY . 

Vectors indexed by boolean sequences in this manner can be interpreted as Binary De¬ 
cision Trees, as illustrated in figure 1. The transition to Binary Decision Diagrams [4] then 
involves elimination of unnecessary nodes and sharing of common subtrees. 


3 Computing Kronecker products efficiently 


The Kronecker product A® B for a 

{k X /) 

matrix A and a (m 

the following {km X In) matrix: 

{ ttiiZ? 

CI12B • 



a2iB 

022^ 

• Ci 2 lB 


\akiB 

ak2B ‘ 



matrix B is defined as 
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The Kroncckcr product is associative, but not commutative. Iterated Kronecker products 
arc defined as usual: 

0 n n— 1 

yl/ij = ylo , ^^k ® • 

A :=0 k^O ^=0 

The following identity relates the Kroncckcr product and ordinary matrix multiplication, 

(/li ® D\) • (yl2 0 B 2 ) = Ai • /I 2 0 • i?2 « 

As a consequence, inversion distributes over the Kroncckcr product of nonsingular square 
matrices: 

Next, we derive a recursive algorithm for computing Q • /, where matrix Q is given as a 
Kroncckcr product 

Q — Q i 

1=0 

and binary tree indexing is used for the vector /. The algorithm is efficient because it avoids 
the construction of the Kroncckcr product. First, we consider the case where the Qi is always 
a (2 X 2) matrix. The elements of Qi arc denoted ((3i)j,A:, where j and k take the values 0 
and 1. The algorithm is based on the following recursive equations, which will be proved 
below. We assume, that the dimension of /|c is 2”“^. 

When k — n — \\ ^ 

( Qj) * f\c ~ Qn-1 * f\c 5 
j=k 

otherwise: 

((8)Qi)-/k 

In the proof of these equations, the following abbreviations arc used (/ is the (2 X 2) identity 
matrix): 

Q = ( §) Q;) , =(§)/)• 

j=k+l j=k-\rl 

Note that In,k is an identity matrix which has the same dimension as Q. The case when 
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k = n-lis obvious. The other case is established by the following argument: 


Qi) */|c 

j=k j=A;+l 

__ f iQh)oO • Q {Qk)oi ' f fUo \ 

\{Qk)io'Q {Qk)n'Q) wlci/ 

_ f {Qk)oO * 0 • f\cO + (Q^)oi • Q ‘ f\cl \ 

“ V(0^)io*Q*/|co + (Q^)ii'Q‘/|ci/ 

_ f {Qk)oO * ’ Q * f\cO + (Qa:)o1 * ^n,k * 0 * f\cl \ 

\(Qa:)iO * in,k ' Q ’ f\cO + {Qk)n ‘ h%,k ' Q * /|cl / 

^ ([Qk)00^ln,k {Qk)0l'lnA (Q'fU\ 

V(Qa:)iO • in,k (Qa:)i1 * ^n.kj W ’ / 

(Qfc®/,.,T (q. ■ 

Using these equations, Q • / can be computed recursively by setting k = 0 and c = We 
illustrate how the recursive algorithm works by the following example. Let 

/ = (1 0 0 1 1 0 1 if , 


and Q = Qo® Qi ® Q 2 where each Qj is the matrix: 



The computation of Q • / starts with the four 2 element subvectors /|oo, /|oi? /|io /In? 
which arc transformed scpcratcly by Q 2 > The results of these transformations arc then 
assembled into two 4 clement vectors, which arc in turn transformed by Qi ® into the 
result Q • /. 


Q 2 • /loo ~ 
Q2-/1o1 = 

Q 2 • /|io = (-l) 

<92 -/111 = (“) 


- y 
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- y 
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Of course, when the algorithm is implemented, the Kroncckcr products {Qj ® In,j) need not 
be constructed. (Qj (g) In,j) * v can be computed by applying the (2 x 2) matrix Qj to the 
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blocks i»|o and u|i of the vector v, 
operation is performed: 

j ® In,j) • 

This operation only involves computing linear combinations of the vectors v\o and i>|i with the 
scalars {Qj)kt- The original matrix formulation, however, gives a more concise presentation 
of the algorithm. 

This algorithm is easily generalized to Q transforms over Z^, where the Q transform is 
made up from (/ X 1) matrices Qj. The recursive equations, howwer, also work for (m X 1) 
matrices Qj. In this case we have: 

<3=(§)gJ, /.,* = (§/"*)• 

J=0 j=k+l 


So, instead of matrix multiplication, actually the following 

/ {Qj)oo * + {Qj)oi • v\i \ 


w^here is the (m X m) identity matrix. Thus, In^k is a square matrix of dimension 
The appropriate recursive equations are a natural generalization of the case when I = 2. 
When k = n — 1: 


otherwise: 


( 


j=zk 


j=k 


I'/I.. 


(® Qi 

) • /u 

n-1 

( (8) Qj 

j=k+l 

)-/u 



These recursive equations can be used to evaluate the Q transforms, as will be explained 
below'. 


4 Hybrid spectral transforms 

In the remainder of the paper, we will restrict our attention to functions that map boolean 
vectors to Z) = Z 2 or Z. Such functions F : D may be uniformly expressed using the 

so-called mintcrm-rcprcscntation. Let • and + be the standard multiplication and addition 
operations on Z 2 and Z. Also, let c : (0,..., 2^' — 1} Z?” be the encoding for boolean 
sequences from 2. The minterm m{h) for a vector b G is defined as follow's: 

m(6)=n<.> where = J 
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The minterm representation of F : —>■ D is given by: 

2”-l 

F{xo,..., Xn-i) = Y^m{c{i))-fi . 

i=0 

This sum can be regarded the scalar product m'^ f of the mintermrvcolor 
m=(m(c(D)) m(c(l)) ... m(c(2'^“l))y 

and 

/=(nc(0)) ... F{c{2--1))) 

The minterm vector can be expressed as a Kroncckcr product: 

71—1 rj 

>« = ( <8) ( ^ ^‘ ) ) 

7=0 

For example, when n is 3, the minterm vector is given by: 

0 : 2 ) 

'^xiX2 a : o ^^ xq'^X2 xqXi^ XQX 1 X 2 ) . 

The concept of minterm representation is easily generalized to get other representations 
of the same function F: 

F = m‘ f = m^ If ^ {m^Q-^){Qf) 

w'hcrc / is the appropriate identity matrix, and Q is some non-singular matrix. The vector 
Q/ is called the Q spectrum of F with respect to the spectral transformation matrix Q. Since 
Q is non-singular, the spectrum of a function provides a canonical formfor the function. This 
is easy to see, since <5/i = Qf 2 iff fi ~ / 2 - In general, any nonsingular matrix Q can be 
used for this purpose. Ilowwcr, in practice it is desirable for Q to have a regular structure: 

Q = - 

i=0 

For boolean functions it is useful to restrict spectral transforms to Kroncckcr products of 
(2 X 2) matrices over (0,1,—1}. There arc twelve relevant eases, all other non-singular 
matrices arc either scalar multiples or can be obtained by multiplication with a diagonal 
matrix. 

(i;) (! n (-;;) (; -i) (; -O c i) 

(? i) c!) a i) (-::) (-;:) n -0 

The upper six matrices have been assigned names in the literature. They arc (from left to 
right): The 67^annon-matrix, Reed-Muller mzilrix^ Arithmetic kFa/ 5/1 matrix, nega¬ 

tive Davio matrix, and the inverse negative Davio matrix. The Shannon and Reed-Muller 
matrices arc usually interpreted over Z 2 , whereas the arithmetic and Walsh matrix arc de¬ 
fined over the integers [14]. Generally, two important eases of the Q transformation arc 
distinguished: 
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Q = ®a:Qoj the homogeneous transformation [10], 

Q = Qk, iiot all Qk s arc equal: the heterogeneous, or hybrid transformation [ 7 ], 

Homogeneous transformations formed from the Walsh matrix arc called Walsh-transforma- 
tions. Likewise homogeneous transformations formed from the Rccd-Mullcr matrix arc called 
Rccd-Mullcr transformations. Similar conventions arc observed for the other matrices. 

Choosing Kroncckcr products to define spectral transformation matrices for boolean func¬ 
tions has several advantages. First, using the recursive algorithm given in J, the spectrum of 
any given function can be computed efficiently without actually ever constructing the huge 
transformation matrix. Enhancing the representation of the vector from binary tree indexing 
to a BDD-representation improves efficiency considerably due to massive sharing of subvec¬ 
tors. Second, the utilization of Kroncckcr products of (2 X 2) matrices in the transformations 
results in a modular representation of the function, which generalizes the notion of MTBDD 
to Q transform diagrams. 

We illustrate the heterogeneous ease with an example. Let F : D he given by 

the table F(0,1) = 0, and ^( 61 , 62 ) = 1, otherwise. In this ease, the vector / is given by: 
/ ( Q 1 1 1 ). The minterm representation of F is 

F{xi,X2) = ♦ 0 + ‘^X2 • 1 + • 1 -f X 1 X 2 • 1 . 

F is interpreted over the integers (thus x = 1 — a:). The spectrum of F with respect to the 
heterogeneous transformation Q = Qq ® Qi where Qo is the Arithmetic matrix and Qi the 
Walsh matrix is given as follows: 



According to the definition above, the Q transform gives a new term representation for F: 




/-I -1 0 0 \ 

X^Xi 1 “1 1 ^ ^ 

2 —1 —1 “1 —1 
XqXi) \-l 1 -1 Ij 




1 — 2a:i 
Xq 

a:o(l - 2 x 1 ) 


= Xi + Xo(l - Xi) 


— X\ T 



Of course, this representation is equivalent to the minterm representation. 




5 Hybrid transform diagrams 

The term-representation of F using a suitable Q transform may bo considerably shorter and 
more efficient to evaluate than its equivalent minterm representation. We develop BDD-like 
representations for Q transforms, which allow efficient computation and evaluation of such 
transforms. 

Let F be a D valued boolean function in the variables a:o,..., and 

Q = '<S)Qi • 

i=0 


Then, the Q transform of F is given by 

F{xo,...,Xn-i) = 

wffiere f = Qf is the Q spectrum of F. Inserting the definition of Q as well as the decom¬ 
position of m as mentioned earlier we obtain: 

= ((^(^ ajj)) • ■ / 

j=0 1=0 

i^o 

using the distributivity property of Kronecker and matrix product. Now, for any given 
assignment to the variables, the value of the transform of F can be computed efficiently 
using the generalized recursive algorithm from section 3. Since (a:,- is always a 

(1x2) matrix, the identity matrices In^k degenerate into scalars, which makes the recursion 
particularly simple. However, in order to compute different values of the same transform, 
data-structures are needed to represent the transform efficiently. The key to this represen¬ 
tation also comes from the recursive equation at the end of section 3. Intuitively, this can 
be seen best by unfolding the recursion a few steps: 


1=0 





\ 

((scT a:i)-QrT 

J=2 

n—1 



((g)((^ 

\ j=2 

^ 3 ) ■ Qf)) ■ f\oi ^ 



/ 

(<8) (( 

Xj) ■ Qf)) ■ f\w^ 


((^ a:i)-QrT 

3=2 

n—1 




\ 

X^f ■ Qf)) ■ f\n ^ 

/ 
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Again, the product ((ccj Xj)' Qj • v can be regarded a block operation on t»|o and v\i: 

((^ a:;/ ) • Q7^) • V = lj(xj) • v|o + rj(x,) • t)|i 
where ^ 

lj{xj) = ’ {{Qj)n^j ~ 

” det^ * ((Qj)oo^j “ (Qj)oi^j) 

With this notation, the recursive evaluation of the Q transform of F can be written in 
the following manner (a: = (cco,..., ): 

U , fn _ / ’ *^1=^ if lc| = n - 1 

eva (a., / |cj - I ^ cval(x, /|co) + ' cval(a:, /|,i) otherwise 

The value of F at a: can be computed via F{x) = eval(a:, /je). The structure of this recursion 
obviously follows a binary tree-pattern, so, the natural choice to represent the Q transform 
is an annotated binary tree, w'hich w^e call the Q transform tree. The leaves of a Q transform 
tree contain the elements of the Q spectrum, whereas the branches on level j are labeled 
with lj{x) on the left branch and rj(a:) on the right branch. 

An example best illustrates the situation. We compute the Q transform tree for 

/=(1 -1 1 -1 2 -4 2 -2)'^ , 

where Q = Qo® Qi ® (32, with the matrices 



The Q spectrum Qf can be computed as described in section 3: 

Q/=(3 0 0 2 -1 0 0 -2)'^ . 

The evaluation of the Q transform follows an analoguous recursive scheme. This scheme is 
displayed below with the products (^ ) • QJ^ already evaluated. 

/ 

(1 a:i-l) 

F{x^,X2,■x^) = {\ 1(2X0-1)) 

(1 * 1 - 1 ) 

\ 

= 1 -j- a:o — 2x2 — 4xoX2 — 2xiX2 — 2xoXiX2 

The recursive scheme can be represented conveniently by a tree. We call such a tree a 
Q transform tree. Figure 2 shows the Q transform tree for the example above. 
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Figure 2: Q transform tree for F 

More formally, we define the Q transform tree T for /, where the spectral transformation 
Q is given by a Kronecker product of (2 x 2) matrices 

71-1 

Q = Q i , 

i=0 

and the vector / is of dimension 2“. For any k < n — 1, and boolean sequence c of length 
less than n — 1, the A:, c subtree of T is defined as follows. 

the left subtree of is T;t+i,cO) the branch leading to it is labeled with 

the right subtree of is the branch leading to it is labeled with 

Tn-i^c is defined by: 

the left subtree of Tn-i^c is the leaf /co, the branch leading to it is labeled with 
the right subtree of Tn-i^c is the leaf /d, the branch leading to it is labeled with r-n-i (a:); 
T itself is its own subtree To^e- 

In the case of the Shannon-transform at ion, a decomposition of the function F itself along 
these lines is known as the Shannon-expansion w.r.t. the variable Xj: 

F = {xj x^){Fl,=o 

For arbitrary Q transformations we define the Q expansion with respect to Xji 

F={{^ Xi)Qf){QAPU,-o Fk=if) . 

These expansions just describe the node-operations on the Q transform trees. Thus, each 
level of a Q transform tree can be regarded as a kind of Qj expansion with respect to the 
variable Xj. 
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Homogeneous Shannon transform trees are an interesting special case. Since the Shannon 
transformation matrix is the (2 x 2) identity matrix, the labeling on the branches becomes 
particularly simple: 

lj{x) = Xj , rj(x) = Xj . 

Thus, at every node in such a tree, one of the two branches starting at that node is labeled 
0 and the other 1. So, these trees actually arc decision trees; this is not necessarily the case 
for other transforms. 

The space required to represent boolean functions by Q transform trees can be greatly 
reduced in certain situations. Obviously, space can be saved by converting these trees to 
directed acyclic graphs^ where identical subtrees arc shared. Additional reduction in space 
arises from the elimination of unnecessary nodes. A node in a tree is unnecessary, if both its 
subtrees arc identical. Such a node can be eliminated, after an adjustment is made to the 
label of the branch preceding this node. Without loss of generality consider a tree where one 
node on the first level has identical subtrees. This tree is represented by the term: 






Here, A, B and D’ arc the subtrees, where A occurs twice as a subtree of the same node. 
This expression can be simplified as follow's: 






dx,) r4x,)) (jfj/) 






A 


Elimination of unnecessary nodes can be expressed graphically as show^n in figure 3. The 
unreduced tree on the left corresponds to the original formula in the derivation. The tree 
on the right corresponds to the last formula in the derivation and shows the effect of the 
reduction. 
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Figure 3: Elimination of unnecessary nodes 


The ordering of the variaMes for Q transform trees has not been considered so far. The 
variable ordering determines which reductions can be made, and can have a dramatic effect 
on the size of the final directed acyclic graph. Since this topic has been discussed extensively 
in the literature [13, 16], we will not discuss it further in this paper. 

Now, for any hybrid Q transformation, we define the corresponding hybrid Q transform 
diagram to be the Q transform tree together with the additional operations of node elimi¬ 
nation, sharing of common sub diagrams and variable ordering. Various transform diagrams, 
that appear in the literature, can be classified using this terminology. For example, MTB- 
DDs can be understood as homogeneous Shannon transform diagrams. Some of the most 
commonly used diagrams arc listed in the table below. 


Matrix 

1 

(; ;) (1 0 (; -i) (-: ;) (: -0 

Name 

Expansion: 

(l{x) r(x))v 

Shannon Heed-Muller Arithmetic Walsli 

Positive Davio Negative Davio 

(x (x —X x)'i/ (1 x)v (1 x)'t; ^(1 x—x)<^ 

Homogeneous 

Diagrams 

Heterogeneous 

Diagrams 

BDD [1.4] FDD [5. 15] — BMD [5] WDD [18] 

MTBDli [e] ACDD [18] 

^-KDD [12]-1 

i -Hybrid transform diagrams [7]- > 


6 Summary and directions for future research 

In this paper we provide a uniform algebraic framework for computing spectral transforms 
[10] and hybrid transform-diagrams [7, 8] in an efficient manner. The entire discussion is 
based on properties of the Kroncckcr product. We derive a set of recursive equations, which 
leads naturally to an algorithm for evaluating products of the form Qv where Q is given 
as a Kroncckcr product, and v is a vector. We show how various spectral transforms like 
the Walsh transform and the Rccd-Mullcr transform can be computed efficiently using this 
algorithm. Many applications of these transforms in digital design which were impossible 
because of memory constraints, have now' become feasible [10]. The same set of recursive 
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equations also gives a new w^ay of explaining hybrid transform diagrams, an efficient data- 
structure for D valued boolean functions. The use of such diagrams has resulted in the 
development of new' verification methods for computer arithmetic, like w'ord level model 
checking [9]. 

It is clear that these ideas are not confined to applications in digital circuit design. D 
valued boolean functions, expressed in terms of hybrid transform diagrams (in particular 
MTBDDs) can be used to represent large matrices [6]. The arguments of these functions arc 
the binary representations of the row and column indices of the matrices. The applications of 
such methods in numerical analysis and linear algebra arc obvious. Gaussian Elimination / 
LU decomposition with pivoting and iterative methods for solving systems of linear equations 
arc typical cxamplcs[2, 6]. Many problems in graph theory like the all pairs shortest path 
problem for large graphs with weighted edges can also be formulated in terms of matrices and 
then solved by the methods presented in [2, 6]. Finally, Markov analysis and probabilistic 
model checking involve huge matrices, and may ultimately benefit from these techniques 
[2, 3]. 
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